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ABSTRACT 

We introduce a new linearly constrained minimum variance 
(LCMV) beamformer that combines the set-membership 
(SM) technique with the conjugate gradient (CG) method, 
and develop a low-complexity adaptive filtering algorithm for 
beamforming. The proposed algorithm utilizes a CG-based 
vector and a variable forgetting factor to perform the data- 
selective updates that are controlled by a time-varying bound 
related to the parameters. For the update, the CG-based vec- 
tor is calculated iteratively (one iteration per update) to obtain 
the filter parameters and to avoid the matrix inversion. The 
resulting iterations construct a space of feasible solutions that 
satisfy the constraints of the LCMV optimization problem. 
The proposed algorithm reduces the computational complex- 
ity significantly and shows an enhanced convergence and 
tracking performance over existing algorithms. 

Key words — Set-membership filtering, conjugate gradi- 
ent algorithms, adaptive algorithms, beamforming. 

1. INTRODUCTION 

Beamforming is an ubiquitous task in adaptive filtering 
and array signal processing problems, and has been found 
widespread applications in radar, sonar and wireless commu- 
nications. Among the existing techniques, the most promis- 
ing one is the optimal linearly constrained minimum variance 
(LCMV) beamformer (T) due to its simplicity and effective- 
ness. The LCMV beamformer aims to suppress interference 
at the array output while improving the reception of the de- 
sired signal. The constraint corresponds to prior knowledge 
of the array response of the desired user cl(8q) G C mxl , 
where 6q is the direction of arrival (DOA) of the desired 
signal and m is the number of sensor elements in the array. 

The optimal LCMV beamformer requires the computa- 
tion of the inverse of the covariance matrix R = E[rr H ] G 
C mxm with r G C mxl being the received vector, and re- 
sults in a heavy computational load. Many adaptive filtering 
algorithms have been reported to realize the beamformer de- 
sign efficiently. The well-known adaptive algorithms include 
stochastic gradient (SG), recursive least squares (RLS), affine 
projection (AP), and conjugate gradient (CG) (E]-[|6|. The 
SG algorithm is simple to implement but suffers from a slow 



convergence rate and the misadjustment. The RLS algorithm 
enjoys fast convergence but is more complex to implement 
and may become unstable due to the divergence problem and 
numerical problems J2). The AP algorithm requires the inver- 
sion of a matrix whose dimension is given by the projection 
order, which results in a heavy computational load of the AP 
algorithm if chosen as a large number. Besides, the conver- 
gence of the AP algorithm is often much slower than the RLS. 
The CG algorithm has a good tradeoff between performance 
and complexity since it has a faster convergence rate than the 
SG and AP algorithms, and requires a lower computational 
cost when compared with the RLS algorithm. Many adaptive 
CG algorithms have been reported in J4]-|]6], and the refer- 
ences therein. Modified CG versions based on the LCMV cri- 
terion can be found in j7j, whereas for other subspace-based 
algorithms the reader is referred to [181- 11141 . 

In this paper, we introduce a more economic adaptive al- 
gorithm based on the CG method for the LCMV beamformer 
design. The proposed algorithm utilizes the set-membership 
(SM) technique lfl5l . Ifl8ll to enforce the constraints and to re- 
duce the computational complexity significantly without per- 
formance degradation. The SM specifies a bound on the mag- 
nitude of the array output and performs data-selective updates 
to estimate the filter parameters. It involves two steps: 1) in- 
formation evaluation and 2) parameter update. If step 2) does 
not occur frequently, and step 1) does not require much com- 
plexity, the overall complexity can be saved substantially. SM 
algorithms based on the SG and RLS methods have been re- 
ported in |[T5l - lfT9l . Here, we use the SM technique in the 
CG algorithm that was reported in 0, and develop a new 
adaptive algorithm, which is termed SM-CG. Specifically, we 
define a new LCMV optimization problem related to a con- 
straint on the bound of the array output, and perform the filter 
optimization to calculate the solution. A parameter dependent 
time-varying bound is employed to measure the quality of the 
filter parameters that could satisfy the constraints and to im- 
prove the tracking performance in dynamic scenarios. The 
parameters are only updated if the bounded constraint can- 
not be satisfied. For the update, we define a new CG-based 
vector v G C mxl to create a relation with R and a(9o), 
namely, v — R~ 1 a(Qo). The proposed algorithm calculates 
v via one iteration per update to obtain filter parameters with- 
out the matrix inverse. The updated parameters are encom- 



passed in a parameter space, in which each member is con- 
sistent with the bounded constraint and the constraint on the 
array response based on the optimization problem. Compared 
with the existing algorithms, the proposed algorithm exhibits 
an enhanced convergence and tracking performance with rel- 
atively low computational complexity. Simulation results il- 
lustrate the performance of the proposed SM-CG algorithm. 

2. SYSTEM MODEL AND BEAMFORMER DESIGN 

Let us suppose that q narrowband signals impinge on a uni- 
form linear array (ULA) of m (q < m) sensor elements. The 
sources are assumed to be in the far field with DOAs 6q, 
0a-i. The received vector r can be modeled as 



A(0) 
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tors a(0 k ) = [l,e~ 27rj ^ . . . j6 --.m— ^ G 
C" ixl , (k — 0, ... ,q — 1), where A c is the wavelength 
and d = A c /2 is the inter-element distance of the ULA, and 
to avoid mathematical ambiguities, the steering vectors a(6k) 
are considered to be linearly independent, s 6 C qxl is the 
source data, n <E C mxl is the white Gaussian noise, and (-) T 
stands for the transpose. The output of a narrowband beam- 
former is 

(2) 
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is the complex weight 



vector of the adaptive filter, and (-) H stands for the Hermitian 
transpose. For the optimal LCMV beamformer, the aim is to 
solve the optimization problem 



minE[|jy| 2 ] = w H Rw 



subject to w H a(6o) 



(3) 
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where 7 is a constant, and R is the covariance matrix of the re- 
ceived vector. The solution of (O is w 0Dt = bttt^t); , ■ 
The SG, RLS, AP, and CG algorithms have been employed to 
realize the design in different ways. Among them, the CG- 
based algorithms exhibit some advantages due to their attrac- 
tive tradeoff between performance and complexity. 

3. PROPOSED SM-CG ALGORITHM 

In this section, we introduce a new constrained optimization 
strategy that combines the SM technique with the LCMV de- 
sign and utilizes the CG-based adaptive filtering algorithm. 

3.1. Time-varying SM-CG scheme 

In the proposed scheme depicted in Fig. [TJ the received vec- 
tor r(i) is processed at time instant i by the LCMV filter con- 
trolled by the adaptive CG algorithm to generate the output 
y(i). For the existing CG algorithms j4]-||5l, it is necessary 
to update w(i) for each time instant i with many iterations to 
obtain a good performance. In the proposed scheme, the SM 



technique is embedded to specify a time-varying bound 6(1) 
on the amplitude of y(i). The update only performs if the 
bounded constraint \y(i)\ 2 < |<5(*)| 2 cannot be satisfied. For 
each update, some valid estimates of w(i) satisfy the bound. 
Thus, the solution to the proposed scheme is a set in the pa- 
rameter space. 
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Fig. 1. Proposed SM-CG structure 

The time-varying bound 6(1) is a unique coefficient for the 
proposed scheme to check if the update is carried out or not. It 
is better if 5(i) could reflect the characteristics of the environ- 
ment since it benefits the tracking of the proposed algorithm. 
We introduce a parameter dependent bound (PDB) that is sim- 
ilar to the work in ||201 and involves the evolution of w(i) ob- 
tained from the proposed algorithm. The time-varying bound 



5(i) = f35(i - 1) + (1 - 0) y/ a \\w{i-\Wal{i), (4) 

where f3 is a forgetting factor that should be set to guarantee 
a proper time-averaged estimate of the evolutions of w(i — 
1), a (a > 1) is a tuning coefficient that impacts the update 
rate and convergence, and er^(i) is an estimate of the noise 
power, which is assumed to be known at the receiver. The 
term \\w(i — 1) || 2 <T^(i) is the variance of the inner product of 
the weight vector with the noise that provides information on 
the evolution of w(i — 1). The time-varying bound provides 
a smoother evolution of the weight vector trajectory and thus 
avoids too high or low values of the squared norm of w. The 
proposed SM-CG scheme utilizes the time-varying bound to 
create a relation between the estimated parameters and the 
environment. 

According to 5(i), we define "Hi to be the set containing 
all the estimates of w(i) for which the associated array out- 
put at time instant i is consistent with the bound, which is 
given by Hi = {w(i) e C mxl : \y(i)\ 2 < S 2 (i)}. The 
set Hi is referred to as the constraint set, and its boundaries 
are hyperplanes. Then, we define the exact feasibility set 0^ 
to be the intersection of the constraint sets over the instants 
I = 1, . . . , i, which is 



n «« 



(5) 
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where So(i) is the transmitted data of the desired user and S 
is the set including all possible data pairs {so(i),r(i)}. It is 
clear that should encompass all the solutions that satisfy 
the bounded constraint until i — > 00. In practice, S cannot be 
traversed all over. Therefore, we define a more practical set 



(membership set) ^ = Di=i ^-i instead. The membership 
set is a limiting set of the feasibility set. They are equal if the 
data pairs traverse S completely. 

3.2. Proposed SM-CG Adaptive Algorithm 

We derive a new adaptive algorithm based on the SM-CG 
scheme. It begins with an LCMV optimization problem that 
incorporates the constraint on the bound of the array output: 



The direction vector p(i) is obtained by a linear com- 
bination of the previous direction vector and the negative 
gradient vector g(i) = a(9^) — R(i)v(i) of J(v(i)) = 
v H (i)R(i)v(i) ~ 2?ft{v H {i)a(9 )} Q, which is 



P(i + I) = g(i)+P(i)p(i), 



(11) 



minimize E[|u> ff r(i)| 2 ] = w H Rw 

subject to w H a(9o) = 7 and |y(i)| 2 = S 2 (i), 



(6) 



where S(i) determines a set of solutions of w within the con- 
straint set H with respect to each time instant. 

The constrained optimization problem can be transformed 
into an unconstrained one by the method of Lagrange multi- 
pliers. The Lagrangian is given by 

i-l 

J(w(i)) = K\i)w H {i)r{l)r H {l)w{i) 
2=1 

+ 2\ 1 (i)m{\w H (i)r(i)\ 2 - S 2 (i)} + 2\ 2 m{w H (i)a(6 Q ) - 7}, a (j) 

(7) 



where f3(i) is chosen to provide conjugacy J5] for the direc- 
tion vectors. 

In order to derive the coefficients a(i) and (3(i), we con- 
sider a recursive form of g(i) 

g(i) = g(i - 1) - a(i)R{i)p(i) - Ai(i)r(i)r ff (i)v(i - 1). 

(12) 

From 0, the coefficient a(i) should satisfy the conver- 
gence bound < p H (i)g(i) < 0.5p H (i)g(i - 1) J5). Ac- 
cording to this bound, premultiplying (TTZt with p H (i) and 
making a rearrangement, we have 



0.5p H (i)g(i - 1) - \ 1 (i)p H (i)r(i)r H (i)v(i - 1) 
p H (i)R(i)p(i) 
p H (i)g(i) - \\{i)p H \i)r(i)r H (i)v(i - 1) 



< 



p»{i)R(i)p{i) 



< 



(13) 



where selects the real part of the quantity, plays 
the role of the forgetting factor and Lagrange multiplier with 
respect to the bounded constraint and is calculated only if the 
bounded constraint cannot be satisfied. The scalar A2 is an- 
other Lagrange multiplier to ensure the constraint on the steer- 
ing vector of the desired user. 

Using the assumption, computing the gradient of w(i) 
with respect to (0 and equating it to a null vector, we have 



a(i) 



The relations in ( TT3T > are satisfied if a(i) is 

(1 - r,)p H [i)g{i - 1) - A 1 ( i )p H ( i )r( l )r ff (i)v(i - 1) 



p H (i)R(i)p(i) 



(14) 



where < 77 < 0.5. 

For /3(i), since p H (i)R(i)p(i + 1) = 0, it follows that 



w(i) 



iR (jHgo) 

a H (9 Q )R^(i)a(9 ) 



(8) 



p H (i)R(i)g(i) 
p H (i)R(i)p{i)' 



(15) 



where R(i) — R(i — 1) + \i(i)r(i)r H (i) can be regarded as 
an alternative form to estimate the covariance matrix R. 

To calculate w(i) efficiently, we adopt the CG-based 
adaptive algorithm due to its attractive tradeoff between per- 
formance and complexity. Specifically, we define a CG-based 

vector v(i) = R a(9o) and use an iterative way to calculate 
it. The resulting solution can be written as 



The coefficient Ai(i) is important to obtain the filter pa- 
rameters. The SM technique provides an adaptive strategy to 
obtain it following the changes of the scenarios. Substituting 
( [Tol l and (fl4l into the bounded constraint in © and perform- 
ing some algebraic manipulations, we obtain 



Ai(i) 



w(i) 



7i>(j) 



Au(i) - \\2{i) 
Ai 3 (i) - Ai 4 («) : 



(16) 



a H (6 )v(i)' 



(9) 



where v{i) is viewed as an intermediate weight vector for en- 
forcing the constraints and avoiding the matrix inverse. In the 
following, we describe a simple CG procedure with only one 
iteration per update to calculate v(i) for computing w(i). 
The CG-based vector is expressed by 



v(i) = v(i — 1) + a(i)p(i), 



(10) 



where p(i) is the direction vector and a(i) is the correspond- 
ing coefficient. 



where 

An(i) = ri(i)sign{r 1 (i) - r 2 (i)}; 
Ai2(i) = T3(i)sign{r3(i) - Ti(i)}\ 
Ai 3 (i) = r 2 (i)sign{ri(i) - r 2 (i)}; 
Ai4(i) = T4(i)sign{r3(i) — Ti(i)} 

n(i) = S(i)v H (i - l)a(e )p H (i)R(f)p(i) + S(i)(l - V )g H (i - 
l)p(i)p H (i)a(8 ) 

74(i) = v H (i - l)r(i)r H (i)p(i)p H '(i)a(flo) 

T 3 (i) = v H {i-l)r{i)p H {i)R(i)p{i) + (l-i 1 )g H (i-l)p{i)p H (i)r{i) 
Tili) = v H {i - l)r(i)r H [i)p(i)p H (i)r{i). 

The proposed SM-CG algorithm is summarized in Table 
Q] where the initialization is given to ensure the constraint 



Table 1. THE PROPOSED SM-CG ALGORITHM 
Initialization: 

g(0) = p(l) = g(flo); w(0) = a(6 ) /\\a(0 o )Y- 
For each time instant i — 1, . . . , N 

y(i) = w H (i — l)r(i) 

5(i) = f3S(i - 1) + (1 - /3)y/a\\w(i-lWa2{i) 
if \y{i)\ 2 >8 2 {i) 

Ai(i) = l 11< i'\~ ) : i2( i i \ 

R(i) = R(i - 1) + Ai(i)r(i)r H (j) 

/,N = (l-^)p H (i)g( i -l)-A 1 (i)p H (i)r(i)r g (i)-u(i-l) 

v(i) = w(i — 1) + a(i)p(i) 
g(i) = g(i - 1) - a(t)H(i)p(i) 
-Ai(i)r(i)r H (i)w(i - 1) 

f>(;\ _ p g (i)H(i)g(») 
^ pH(i)R(i)p(i) 

p(i + l) = g(i)+/3(i)p(i) 

else 

= — 1) 

end 

™W - aH(%)„(i) 



on the steering vector of the desired user and to start the up- 
date. From Table Q] the coefficient Ai(i) is calculated only if 
the bounded constraint cannot be satisfied, so as the update 
procedure. The data-selective updates save the computational 
cost significantly. Compared with most existing CG-based al- 
gorithms (7), the estimation of v(i) in the proposed algorithm 
only runs one iteration per update, which further reduces the 
complexity. All the estimates w(i) ensuring the bounded con- 
straint until time instant i are in the feasibility set O^. 

Regarding the complexity, the algorithms with the SM 
technique require much less computational cost than their 
counterparts without the SM technique due to the data se- 
lective updates. Since the calculations of the array output 
y(i) and the time-varying bound 8(i) are the same for the 
SM-type algorithms, we check their procedures during the 
updates to compare the complexity. The proposed algorithm 
needs around 2t7Vto 2 additions and 2r7Vm 2 multiplications 
for the operation, where t (0 < r < 1) is the update rate. 
These computational requirements are greater than those of 
the SG-based algorithm |[T5l , Ifl9l (StNtti for additions and 
ArNm for multiplications) but much less than the RLS-based 
algorithm [[18), ED (4rA r m 2 for additions and hrNm 2 for 
multiplications), and the AP-based algorithm [?] {rNrnL 2 
for additions and multiplications) with L being the size of 
the signal matrix. In the following part, we will see that 
the proposed algorithm spends less updates than the existing 
algorithms but has a fast convergence and shows an excellent 
tracking performance. 

4. SIMULATIONS RESULTS 

We evaluate the output signal-to-interference-plus-noise ra- 
tio (SINR) performance of the proposed and existing algo- 
rithms for the LCMV beamformer. Specifically, we com- 
pare the proposed algorithm with the SG and RLS algorithms 
with/without the SM technique J2], 0, H3, QU, and the 



AP algorithm with the SM technique (SM-AP) [?]. We as- 
sume that there is one desired user in the system and the re- 
lated DOA is known beforehand by the receiver. The results 
are averaged by 500 runs. We consider the binary phase shift 
keying (BPSK) modulation scheme and set 7 = 1 for the al- 
gorithms. Simulations are performed with a ULA containing 
77i = 16 sensor elements with half- wavelength interelement 
spacing. 

In the first experiment, there are q = 10 users in the sys- 
tem. The input signal-to-noise ratio (SNR) is 10 dB and the 
interference-to-noise ratio (INR) is 30 dB. We set a = 21, 
/3 = 0.9 and 77 = 0.5 for the proposed algorithm. Note that 
Xi(i) should be a small positive value close to but less than 1 
in accordance with the setting of the forgetting factor. In sim- 
ulations, we limit its range 0.1 < Ai(i) < 0.999. In Fig. [2 
the curves of all the algorithms converge to their steady-state 
following the increase of the snapshots. The algorithms with 
the SM technique show faster convergence rates than the stan- 
dard algorithms. The proposed algorithm has a convergence 
comparable to that of the SM-RLS algorithm and the steady- 
state performance has a SINR level close to that of the MVDR 
solution. It only requires r = 6.0% updates (178 updates 
for 3000 snapshots) for the filter design, which is lower than 
those of the existing algorithms and thus reduces the com- 
plexity significantly. 
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Fig. 2. Output SINR versus the number of snapshots. 

The next experiment shows the output SINR performance 
for the proposed algorithm under a non-stationary scenario, 
namely, when the number of users changes in the system. The 
system starts with q = 8 users including one desired user. The 
input SNR is 10 dB and the INR is 35 dB. The coefficients are 
the same as those in Fig. |2]except a = 23. From the first stage 
(first 3000 snapshots) of Fig. [3] the proposed algorithm con- 
verges quickly to the steady-state. The scenario experiences 
a sudden change at N = 3000. We have 4 more interferers 
entering the system, which results in the performance degra- 
dation for the studied algorithms. The algorithms with the SM 
technique track this change rapidly and reach the steady-state 
since the data-selective updates reduce the number of updates 



and keep a faster convergence rate. Besides, the time-varying 
bound provides information for them to follow the changes of 
the scenario. The change also influences the update rate of 
the algorithms. According to the statistics, the update rate of 
the proposed algorithm (r = 6.2%) is rather insensitive to the 
change and saves computational cost. 



[4] G. D. Mandyam, N. Ahmed, and M. D. Srinath, "Adaptive beam- 
forming based on the conjugate gradient algortihm," IEEE Trans. 
Aerospace and Electronics Systems, vol. 33, pp. 343-347, Jan. 1997. 






SG 




SM-SG 
(i=21 .7%) 




RLS 






SM-RLS 

(t=9.6%) 




SM-AP 
(1=12.5%) 




CG 




SM-CG 
(i=6.2%) 



2000 3000 4000 

Number of Snapshots 



Fig. 3. Output SINR versus the number of snapshots in dy- 
namic scenario with additional users enter and/or leave the 
system. 



5. CONCLUSION 

In this paper, we have introduced a new adaptive filtering 
strategy that combines the SM technique with the adaptive 
CG algorithm for the LCMV beamformer design. We defined 
an LCMV optimization problem related to a constraint on the 
bound of the array output and proposed a CG-based adap- 
tive algorithm for implementation. The proposed algorithm 
performs the data-selective updates to obtain the filter param- 
eters. For the update, a CG-based vector has been devised to 
create a relation between the covariance matrix inverse and 
the steering vector of the desired user. The proposed SM- 
CG algorithm calculates the CG-based vector to encompass 
a space of feasible solutions with respect to each time in- 
stant and to enforce the constraints. The proposed algorithm 
exhibits a very good convergence and tracking performance 
with relatively low computational cost. 
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